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CLAIMS : 

What is claimed is 



A method for monitoriing responses to test questions 
presented in a data processing system, the method 
comprising the computer implemented steps of: 

identifying presentation of the test questions on 
the data processing system; 

responsive to the presentation of the test questions 

stem, monitoring test question 
test question timing data 
represents an elapsed tine since an answered question 
from the test questions has been presented; and 

generating an alert after the test question timing 
data exceeds a threshold 



on the data processing s) 
timing data in which the 



2. The method of claim 
is performed by a procto;: 
processing system. 



1, wherein the monitoring step 
device or a program on the data 



3. The method of claim wherein the program is an 
applet . 



4. The method of claim 11 further comprising: 

billing a client for jnonitoring the presentation of 
the test questions. 



5. The method of claim 1, 
are part of a test and furt! 

storing an identif icatli 
for the test; and 



wherein the test questions 
her comprising: 

ion of a number of test takers 
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billing a client based op. the number of test takers 
for the test. 

6. A method of monitoring k test question response 
time, comprising the steps qf: 

administering a test tq a remotely located user of a 
client device; 

receiving test questio/n timing data from the client 
device, the test question t/iming data representing an 
elapsed time used in attempting to answer the test 
question; and 

outputting the test Question timing data to a 
proctor device such that the proctor device may monitor 
the elapsed time in attempting to answer the test 
question for the remotely located user. 



7. The method of claim 6, further comprising billing a 
test developer for administration of the test to the 
remotely located user. 



8. The method of cla 
the remotely located us 



itn 6, further comprising billing 
er for administration of the test , 



9. The method of cla 
instant message to the 



10. The method of claim 
an instant message from 



Urn 6, further comprising sending an 
client device . 



6, further comprising receiving 
the client device . 



11. The method of cla;.m 6, further comprising 

alerting the remotely located user when the test question 

timing data exceeds a predetermined threshold. 
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12. The method of claim 8, further comprising storing a 
score for the test in a permanent storage. 

13. The method of claim 16, wherein the test is developed 
by a test developer and wherein the method is implemented 
by a test administration/ system that is operated by a 
different entity from the test developer. 



= Ps 



ru 



14. The method of clainj 6, further comprising: 

receiving a requestt for administration of the test 
to the remotely located I user ; 
10 establishing a session identification for the 

administration of the tpst to the remotely located user; 
and 

correlating the telst question timing data to the 
administration of the tjest to the remotely located user 
15 based on the session identification. 



\ 3 

:r.i; s 

m 



15. The method of claim 14, wherein the session 
identification includes a proctor device identifier, and 
wherein outputting the test question timing data to the 



proctor device is basec 



20 16. The method of clailm 
storing an indicatjo 

the test; and 

billing a test 

number of test takers f 



on the proctor device identifier. 

6, further comprising: 
r of a number of test takers for 



develope 



r of the test based on the 
or the test. 
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17. The method of clain 6, further comprising: 

monitoring the tesl: question timing data for 
evidence of greater than expected response time to the 



# 
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test question, wherein outputuing the test question 
timing data to a proctor device is performed in response 
to determining that evidence /of greater than expected 
response time to the test question is present. 



10 



18. The method of claim 16/, wherein monitoring the test 
question timing data for evidence of greater than 
expected response time to the test question includes 
comparing previously received test question timing data 
to currently received testi question timing data to 
determine if a change in the test question timing data 
indicates evidence of grejater than expected response time 
to the test question. 



i y 
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19. The method of claim 6, further comprising 
generating an alert profile for the remotely located user 
for a particular test based on at least one of a data 
profile associated with the remotely located user, an 
examination question timing database, and a degree of 
difficulty associated with a question on the test. 



20. The method of claim 
transmitting an alert to 



19, further comprising 

the remotely located user based 



on the generated alert profile 



21. The method of claim 
response from the remote 
alert profile for use in 



19, further comprising storing a 
ly located user to update the 
future tests. 
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22. The method of claim 5, further comprising storing of 
the timing data for the test question to update timing 
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data for the remotely locate^ user for use in future 
tests . 



23. An apparatus for monitoring responses to test 
questions presented in a da-jpa processing system, the 
apparatus comprising : 

identifying means for /identifying presentation of 
the test questions on the data processing system; 

monitoring means, responsive to the presentation of 
the test questions on the pata processing system, for 
monitoring test question tjiming data in which the test 
question timing data represents an elapsed time since an 
answered question from tpe test questions has been 



presented; and 

generating means fo 
test question timing dat 



24. The apparatus of cl|a 
a proctor device or a pr|og 
system. 



25. The apparatus of cl|a 
applet . 

26 . The apparatus of cl 
billing means for b 

the presentation of the 



generating an alert after the 
exceeds a threshold. 

im 23, wherein the apparatus is 
ram on the data processing 



im 24, wherein the program is an 



27. The apparatus of claim 
questions are part of a tie 
storing means for sto 
number of test takers for 



im 23 further comprising: 
lling a client for monitoring 
est questions. 



23, wherein the test 
st and further comprising : 
ring an identification of a 
the test; and 
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billing means for billing a client based on the 
number of test takers for the test. 
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28. A data processing system 4 om P r i s i n< 3 : 
a bus system; 

a communications unit connected to the bus system; 

a memory connected to the/ bus system, wherein the 
memory includes a set of instructions; and 

a processing unit connected to the bus system, 
wherein the processing unit executes the set of 
instructions to identify presentation of the test 
questions on the data processing system, monitor test 
question timing data in response to the presentation of 
the test questions on the data processing system in which 
the test question timing data represents an elapsed time 
since an answered question / from the test questions has 
been presented, and generate an alert after the test 
question timing data exceeds a threshold. 



29. An apparatus for monijt 

time, comprising: 

a controller; and 
at least one interface 



oring a test question response 



coupled to the controller, 



wherein the controller administers a test to a remotely 



located user of a client de^ 
interface, receives test que 
client device via the at lea 



attempting to answer the tes 
test question timing data tc 



least one interface, such tbiat the proctor device may 



ice via the at least one 
stion timing data from the 
st one interface, the test 



question timing data representing an elapsed time used in 



t question, and outputs the 
a proctor device via the at 
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monitor the elapsed time in attempting to answer the test 
question for the remotely loaated user. 

30. The apparatus of claim £9, wherein the controller 
bills a test developer for administration of the test to 
5 the remotely located user. 



31. The apparatus of claim! 29, wherein the controller 
bills the remotely located fuser for administration of the 
test . 



ni 



m 
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32. The apparatus of claim 29, wherein the controller 
10 sends an instant message tq> the client device via the at 
least one interface. 



33. The apparatus of clai|n 
receives an instant messag 
the at least one interface 



29, wherein the controller 
b from the client device via 



15 34. The apparatus of claim 29, wherein the controller 
alerts the remotely located user when the test question 
timing data exceeds a predetermined threshold. 



35. The apparatus of claim! 29, further comprising a 



storage device, wherein the 
20 the test in the storage devi 

36. The apparatus of claim 



developed by a test developer and wherein the apparatus 



controller stores a score for 
ce. 

29, wherein the test is 



is operated by a different e 
developer. 



r 



tity from the test 
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37. The apparatus of claim 29,/ wherein the controller 
receives a request for administration of the test to the 
remotely located user, establi/shes a session 
identification for the administration of the test to the 
remotely located user, and correlates the test question 
timing data to the administration of the test to the 
remotely located user based qn the session 
identification . 



38. The apparatus of claim J37, wherein the session 
10 identification includes a proctor device identifier, and 
wherein the controller outputs the test question timing 
data to the proctor device pased on the proctor device 
identifier. 



ru 
m 



39 . The apparatus of clai 
15 storage device, wherein th 

indicator of a number of t 
storage device and bills a 
based on the number of tes 

40 . The apparatus of claim 



20 monitors the test environment data for evidence of 



greater than expected resp 
and wherein the controller 



timing data to a proctor device in response to 



29, further comprising a 
controller stores an 
st takers for the test in the 
test developer of the test 
takers for the test. 

29, wherein the controller 



nse time to the test question, 
outputs the test question 



determining that evidence o 



25 response time to the test question is present 



f greater than expected 



41. The apparatus of claiir 40, wherein the controller 
monitors the test question timing data for evidence of 
greater than expected response time to the test question 
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by comparing previously received test question timing 
data to currently received test environment data to 
determine if a change in the nest question timing data 
indicates evidence of greater {than expected response time 
to the test question. 



10 



42. The apparatus of claim 29, further comprising 
generating an alert profile tor the remotely located user 
for a particular test based /on at least one of a data 
profile associated with the/remotely located user, an 
examination question timing/ database, and a degree of 
difficulty associated with /a question on the test. 



25 



43. The method of claim 42, further comprising 
transmitting an alert to uhe remotely located user based 
on the generated alert profile. 



15 44. The method of claim 
response from the remoteljy 
alert profile for future 



2, further comprising storing a 

located user to update the 
ests . 



45. The method of claim 29, further comprising storing 
of the timing data for the\ test question to update timing 
20 data for the remotely locaned user for future ■ tests . 



product 



46. A computer program 
medium for monitoring a tes 
comprising: 

first instructions for 
remotely located user of a 

second instructions for, 
timing data from the client 



in a computer readable 
question response time, 

administering a test to a 
dlient device; 

receiving test question 
device, the test question 
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timing data representing anyelapsed time used in 
attempting to answer the test question; and 

third instructions fori outputting the test question 
timing data to a proctor device such that the proctor 
device may monitor the elaosed time in attempting to 
answer the test question for the remotely located user. 
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47. . A computer program prjbduct in a computer readable 
medium for use in monitoriing responses to test questions 
presented in a data processing system, the computer 
program product comprising 

first instructions fpr identifying presentation of 



the test questions on th 
second instructions 
of the test questions on 
monitoring test question 



question timing data represents an elapsed time since an 



answered question from 
presented; and 

third instsructions 
the test question timing 



data processing system; 

responsive to the presentation 
the data processing system, for 
timing data in which the test 



the test questions has been 

for generating an alert after 
data exceeds a threshold. 



48. The computer progran 
the second instructions ai 



product of claim 47, wherein 
a\ce located in a proctor device 



or a program on the data p 



49. The computer program 
comprising: 

fourth instructions 
monitoring the presentati 



rocessing system. 



product of claim 47 further 



to 



r billing a client for 
n of the test questions. 
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50. The computer program product of claim 47, wherein 
the test questions are part of a test and further 
comprising: 

fourth instructions flor storing an identification of 
a number of test takers fcpr the test; and 

fifth instructions f<pr billing a client based on the 
number of test takers for! the test. 



